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METHOD AND APPARATUS FOR IMAGE SCALING 



BACKGROUND 

This disclosure is related to upscaling an image during decompression. 

Up-sampling or up-scaling of images and/or video is an often employed operation in 
many image processing applications. Often, image and/or video data is down-sampled or 
down-scaled to reduce the resolution of the image frames. This allows it to be compressed to 
transmit it through a limited bandwidth communication channels or to accommodate limited 
storage space, as shown in Fig. 1 , for example. However, it is also often desirable to display a 
higher resolution image or recover the original resolution of the image from the down-sampled 
compressed one. The brute-force method usually followed is to decompress the image first 
and then apply known up-scaling techniques on the decompressed image, as shown in Fig. 2. 
It would be desirable, however, if more efficient techniques to accomplish the same results 
with better or similar image quality were available. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Subject matter is particularly pointed out and distinctly claimed in the concluding portion 
of the specification. The claimed subject matter, however, both as to organization and method 
of operation, together with objects, features, and advantages thereof, may best be understood 
by reference of the following detailed description when read with the accompanying drawings 
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in which: 



FIG. 1 is a schematic diagram illustrating conventional down-scaling to reduce data; 



FIG. 2 is a schematic diagram illustrating conventional up-scaling of an image after 
decompressing a smaller resolution image; 



FIG. 3 is a schematic of one embodiment of a technique for up-scaling during 
decompression of a smaller resolution image; 



FIG. 4 is a block diagram illustrating a conventional encoder and decoder, such as 



FIG. 5 is a schematic diagram of the embodiment of FIG. 3 in greater detail; and 



FIG. 6 is a table illustrating application of the embodiment of FIG. 5 to a particular 
example. 



DETAILED DESCRIPTION 



t\ employed in connection with processing JPEG images; 
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In the following detailed description, numerous specific details are set forth in order to 
provide a thorough understanding of the claimed subject matter. However, it will be 
understood by those skilled in the art that the claimed subject matter may be practiced without 
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these specific details. In other instances, well-known methods, procedures, components and 
circuits have not been described in detail in order so as not to obscure the claimed subject 
matter. 

Briefly, embodiments are provided to permit an up-scaling operation to be achieved 
directly in the decompression process, as shown, for example, in Figure 3. In such 
embodiments, the typical up-scaling employed to convert a lower resolution image to a higher 
one is embedded within the decompression that is performed. Although the claimed subject 
matter is not limited in scope in this respect, it is noted that this approach may be particularly 

o 

® suitable in Discrete Cosine Transform (DCT) based image compression/decompression 

m 

^ systems or in situations that employ such techniques. Up-scaling may be achieved directly in 
%\ the inverse DCT space as described, for example, in connection with the following 
R ' embodiment. 

'"'4 

An up-sampling or up-scaling operation may be embedded into a decompression 
operation, such as, for example, a block based compression/decompression system using 
DCT. Although the claimed subject matter is not limited in scope in this respect, a baseline 
image compression standard, such as JPEG [Joint Photographic Experts Group, Digital 
Compression and Coding of Continuous-tone Still Images, ISO/I EC JTC1/SC29 IS 10918] is 
one example. The process described in the JPEG specification follows the principles of block- 
based transform coding. A block diagram of this approach is shown schematically in Fig. 4. 

As is well-known, the input image is divided into 8x8 blocks. The blocks are then 
independently compressed. First, the 8x8 block is converted from the spatial domain to the 
frequency domain by applying the Discrete Cosine Transform (DCT). The DCT coefficients 

4 
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are then quantized by dividing by a predefined quantization parameter. The quantized 
coefficients are then encoded to generate the compressed data as shown in figure 4(a). 



For JPEG decompression, the inverse operations are applied. The compressed data is 
first entropy decoded to produce the quantized DCT coefficients. The quantized DCT 
coefficients are multiplied by the same or substantially the same quanitzation parameter that 
was used to quantize the original DCT coefficients during the compression process. This is 
called inverse-quantization and produces an approximation of the original DCT coefficients. 
The inverse quantized 8x8 DCT block is then converted into the spatial domain image data by 
applying an inverse Discrete Cosine Transform (IDCT). This is shown in Figure 4(b). 



The two-dimensional Discrete Cosine Transform (DCT) for a 8x8 block may be 
expressed mathematically as follows: 



x C(w)C(v)^^ x (2x + \)un {2y + \)vn u nt n 

F(u,v)= \ Y7L f(x>y)™$- T~ cos \/ — where ii.v =0,1...,7 

4 T^of^o 16 16 

c(«H^ u = 0 (D 

1 else 

The corresponding two-dimensional inverse Discrete Cosine Transform (IDCT) of a 8x8 DCT 
block may, likewise, be expressed as follows: 

f(x,y) = - > > C(m)C(v)F (ii, v) cos — cos J where x, y = 0,1...,7 

16 16 

C(u) = \^ U = ° (2) 

1 else 
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Similarly, the two-dimensional inverse Discrete Cosine Transform (IDCT) of a 16x16 DCT 
block may be expressed as: 



f (x y y) = -2^2^C(u)C(v)F(u,v)cos cos — - where x,y =0,1. ..,15 

8 u =o v= o 32 32 



1 else 



(3) 



In general, an Nx N point two-dimensional inverse DCT may be expressed as 



„ /(*. y) = 2 J 2- C W C ( V ) F ("' V ) C0S — tTt — cos \ M — where x >y = 0,1..., jv -1 

u=0 v-0 



U 



2N 



2N 



^ C(u) = 

Ti 



J— M = I 

VN 

,/— else 
VN 



(4) 



ij Hence, an M x M point two-dimensional inverse DCT may be expressed as 

3 x VVVv M7/ ^ (2* + l)«>r (2j+1)v^ 

f (x 9 y) = 2^2j ( M ^ V ^( M,V ) C0S cos — ^T77 where jc,^ = 0,1..., M -1 



«=0 v=0 



2M 



2M 



C'(«) = « 



J 1 -o 

VM 

J— else 
JM 



(5) 



Similarly, a2Nx2N point two-dimensional inverse DCT (IDCT) may be expressed as 
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2N-\2N-\ 



^ ^ . x (2x + l)u7T (2y + l)v7T , _ m , , 

f'(x,y) = J,, 2^C (u)C(v)F(u,v)cos _' T cos whereby = 0,1..., 2AT-1 



u=0 v=0 



2*2N 2*2W 



C'(u) = < 



— 

'2N 



U = 0 



(6) 



J— else 
VN 



As shall be explained in more detail hereinafter, in embodiments in accordance with the 



claimed subject matter, an image may be up-scaled using the inverse-DCT (IDCT) 
2 operation during decoding. Let us assume, for example, that F(u, v) is an N x N block 
M DCT block, where u = 0,1,.. .,A/-1 and v~ 0,1 AM. Let us extend this 2-dimensional 

--a 

W DCT signal F(u, v) of size A/x A/to another two-dimensional DCT signal F'(u,v) of size 



;^ Mx M (where M > N) by simply multiplying samples in F(u, v) by a scaling factor and 

^ padding F(u, i/^ with zeros to produce F'(u, i/). Therefore, in this particular embodiment, 

O 

2 FYu, v) = k*F(u, v) for every u, v=0, 1 , AM and F'fu, = Ofor every u,v=N, N+1, 



M-1 . This is depicted in the form of a matrix as shown in equation 7 below. 
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F(0,-,#-l:0,-,#-l) 



f F(0,0) 
F(1,0) 



F(0,1) 
F(U) 



F(0,W-1) N 
F(l,iV-l) 



F(N -1,0) F(N -1,1) ••• F(N-l,N-l)J 



f kF (0,0) 
*F(1,0) 



F'(0,--,M-1:0,--,M-1) = 



*F(0,1) 
*F(1,1) 



*F(JV-1,0) JfcF(iV -1,1) 
0 0 
0 0 



0 



0 



1=4 

in 



From Equations 4 and 5 above, 



M 



kF(0,N-l) 0 0 

kF(l,N-l) 0 0 

kF(N-l,N-l) 0 0 

0 0 0 

0 0 0 



0 



0 0 



M*C\u)C'(y) = N*C(u)C(v) or C(u)C(v) = — C\u)C{v) 

N 



> y 



Hence, for convenience, we choose k - — as the scaling factor. Similarly from 

^ N 

ft Equations 4 and 6 above, 



C(u)C(v) = 2C(u)C\v) 



Hence, for an 8x8 DCT block, as one example, although the claimed subject matter is 
not limited in scope in this respect, using the approach just described, we may expand 
the transformed signal by multiplying transformed coefficients by k-2 and then by zero 
padding, e.g., adding 8 extra rows and 8 extra columns of 0's to form a 16x16 block, in 
this example, as shown in Figure 5, after inverse quantization, during a decompression 
operation. The extended 16x16 signal may then be inverse transformed to the image 
domain using a16x16 inverse discrete cosine transform (IDCT), in this particular 
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example. Again, the claimed subject matter is not limited in scope to these particular 
dimensions, of course. However, here, the resulting image is a 2:1 up-scaled image of 
the originally compressed image. 

As the previous example illustrates, the change in standard JPEG 
decompression is to apply a16x16 inverse-DCT on the 0 padded 16x16 block instead of 
an 8x8 inverse-DCT as the final operation in Fig. 4(b). In addition to having the 
advantage of producing the desired results, it is also relatively simple to implement in 
conjunction with existing image processing approaches, such as, for example, MPEG 
A [Moving Picture Experts Group] family of video coding techniques MPEG-1 [ Coding of 

Moving Pictures and Associated Audio for Digital Storage Media at up to about 1 .5 
j Mbit/s, ISO/IEC IS 1 1 172], MPEG-2 [Generic Coding of Moving Pictures and 
Associated Audio Information, ISO/IEC IS 13818], etc. and JPEG. 

2 In embodiments in accordance with the claimed subject matter, therefore, 

without limitation, we may up-scale an image by k:1. For example, an image of size A/x 
N may be up-scaled to size Mx M where, M > A/ and M=k*N by, in this particular 
embodiment, multiplying the DCT coefficients by a scaling factor k = M/A/and zero 
padding to convert, here, an 8x8 block, to an 8k x 8k block. Again, for purposes of 
illustration, without intending any limitation on the claimed subject matter, to upscale an 
image by 1 .25:1 (e.g., an 640x480 image may be up-scaled to 800x600), we may 
upscale 8x8 blocks to size 10x10. This may be done in this embodiment by multiplying 
the coefficients by k = 1.25 and then zero padding the 8x8 block with two extra rows 
and two extra columns, as shown in Figure 6 below. The 8k x 8k block may then be 
inverse transformed by 8k x 8k IDCT in order to produce the Mx M image. 
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The embodiments previously described provide a variety of advantages. For 
example, as alluded to previously, the up-sampling method may be embedded into the 
decoding process and, hence, be transparent to the user. Memory utilization for an 
implementation of this approach is smaller compared to the traditional two-step 
approach, previously described, for up-scaling. Computational complexity and 
implementation complexity is improved relative to the traditional two step process of 
decompressing the image first followed by up-sampling. Furthermore, the 
embodiments previously described are suitable both for hardware and software 
O implementation, and is suitable for on-line imaging applications, such as, video 
^ transmission, reprographics, scanning, and facsimiles, to provide just a few of the 
possible examples. 

S=K3 
\ I 

w 



It will, of course, be understood that, although particular embodiments have just been 



•*4 described, the claimed subject matter is not limited in scope to a particular embodiment or 



N implementation. For example, one embodiment may be in hardware, whereas another 
^ embodiment may be in software. Likewise, an embodiment may be in firmware, or any 
combination of hardware, software, or firmware, for example. Likewise, although the claimed 
subject matter is not limited in scope in this respect, one embodiment may comprise an article, 
such as a storage medium. Such a storage medium, such as, for example, a CD-ROM, or a 
disk, may have stored thereon instructions, which when executed by a system, such as a 
computer system or platform, or an imaging and/or video system, for example, may result in 
an embodiment of a method in accordance with the claimed subject matter being executed, 
such as an embodiment of a method of upscaling, for example, as previously described. For 
example, an image and/or video processing platform or system may include an image or 
video processing unit, a image or video input/output device and/or memory. 
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While certain features of the claimed subject matter have been illustrated and 
described herein, many modifications, substitutions, changes and equivalents will now occur to 
those skilled in the art. It is, therefore, to be understood that the appended claims are 
intended to cover all such modifications and changes as fall within the true spirit of the claimed 
subject matter. 
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